Papers with event-centric video-language systems
Grounding Partially-Defined Events in Multimodal Data (2024.findings-emnlp)
Copied to clipboard
Kate Sanders, Reno Kriz, David Etter, Hannah Recknor, Alexander Martin, Cameron Carpenter, Jingyang Lin, Benjamin Van Durme
| Challenge: | Evidence suggests prelinguistic infants are capable of recognizing discrete events in real-world stimuli. |
| Approach: | They propose a multimodal formulation for partially-defined events and cast the extraction of these events as a three-stage span retrieval task. |
| Outcome: | The proposed approach can extract events from 14.5 hours of annotated current event videos and 1,168 text documents, containing 22.8K labeled event-centric entities. |